Client Level Framework for Parallel Downloading of Large File Systems
نویسندگان
چکیده
In this paper, Mirror sites enable client requests to be serviced by any of a number of servers, reducing load at individual servers and dispersing network load. Typically a client requests service from a single mirror site. We suggest a way for the client to access a file from multiple mirror sites in parallel to speed up the download. We have developed a technique that can deliver dramatic speedups as well as fault tolerance. Our approach doesn‟t require a feedback from the client to the servers, thus speeding up the process even more.
منابع مشابه
On the Effect of Large-Scale Deployment of Parallel Downloading
In the presence of multiple mirror servers that can serve the same information, clients can improve their performance when downloading large files by conncurrently retrieving different parts of the file from different servers. In previous work, experiments with a single client have shown the potential for parallel downloading schemes to improve the performance perceived by this single client. I...
متن کاملA Subscription Overlay Network for Efficient File Parallel Downloading
This paper presents a subscription-based overlay network that supports efficient file parallel downloading. First, the system lets users register to a central server and allows the server to incrementally build a topology graph containing the network connections among the subscribers. With this topology graph in place, we address the challenges of minimizing network traffic and choosing the set...
متن کاملParallel computation framework for optimizing trailer routes in bulk transportation
We consider a rich tanker trailer routing problem with stochastic transit times for chemicals and liquid bulk orders. A typical route of the tanker trailer comprises of sourcing a cleaned and prepped trailer from a pre-wash location, pickup and delivery of chemical orders, cleaning the tanker trailer at a post-wash location after order delivery and prepping for the next order. Unlike traditiona...
متن کاملDesign and analysis of parallel file downloading algorithms in peer-to-peer networks
It is well known that the method of parallel downloading can be used to reduce file download times in a peer-to-peer (P2P) network. There has been little investigation on parallel download and chunk allocation for source peers with random service capacities. The main contribution of this paper is to address the problem of efficient parallel file download in P2P networks with random service capa...
متن کاملAnalysis of Parallel Downloading for Large File Distribution
Recently, the scheme of parallel downloading (PD) has been adopted by a number of Internet file downloading applications. With the wide deployment of content distribution networks and peer-to-peer networks, PD is expected to be more commonly used for file distribution. There have been experiments showing that PD results in higher aggregated downloading throughput and therefore shorter downloadi...
متن کامل